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As  directed  by  the  conference  report  on  the  Department  of  Defense  (dod)  Appropriations  Act 
for  Fiscal  Year  1989  (P.L.  100-4633rwe  reviewed  the  jurisdiction  and  the  mission  of  the 
Office  of  the  Director,  Operational  Test  and  Evaluation,  including  legislative  intent,  to 
determine  whether  the  Operational  Test  and  Evaluation  (OT&e)  Capability  Improvement 
Program  is  within  the  scope  of  that  mission  or  would  be  more  appropriately  conducted  by 
another  dod  organization. 


Although  the  Office  of  the  Director,  ct&e’s  statute  does  not  prohibit  it  from  conducting  the 
0T&E  Capability  Improvement  Program,  we  believe  that  the  program  does  not  fall  within  the 
Office  of  the  Director,  ot&e’s  mission.  We  therefore  recommend  that  the  Secretary  of  Defense 
direct  and  assure  that  the  services  plan,  program,  and  budget  for  adequate  test  resources 
needed  to  conduct  operational  testing  of  weapon  systems  effectively.  The  Director,  ct&e 
should  continue  to  perform  oversight  and  policy  functions  by  reviewing  and  making 
recommendations  to  the  Secretary  of  Defense  to  assure  that  adequate  test  resources  are 
acquired.  CK ^ ^ 


This  executive  summary  is  an  unclassified  version  of  a  classified  report  on  the  same  subject 
(gao/c-nsiad-90-02).  We  will  send  copies  of  this  executive  summary  to  the  Chairmen,  Senate 
and  House  Committees  on  Armed  Services;  the  Secretaries  of  Defense,  the  Army,  Air  Force, 
and  Navy;  the  Director,  or&E;  and  other  interested  parties. 


This  executive  summary  was  prepared  under  the  direction  of  Paul  F.  Math,  Director, 
Research,  Development,  Acquisition,  and  Procurement  Issues  who  may  be  reached  on  (202) 
275-4587  if  you  or  your  staff  have  any  questions. 


Frank  C.  Conahan 
Assistant  Comptroller  General 
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Executive  Summary 


Purpose 


The  Director,  Operational  Test  and  Evaluation,  established  the  Opera¬ 
tional  Test  and  Evaluation  (ot&e)  Capability  Improvement  Program  to 
acquire  test  resources  for  improving  the  realism  of  ot&e  conducted  on 
major  weapon  systems.  The  Director,  crr&E  believed  that  the  services’ 
lack  of  funding  for  test  resources  could  have  a  detrimental  impact  on 
Ot&e  results.  These  results  are  important  in  making  key  acquisition  deci¬ 
sions,  especially  the  decision  to  proceed  from  development  to 
production. 

As  directed  by  the  conference  report  on  the  Department  of  Defense 
(dod)  Appropriations  Act  for  Fiscal  Year  1989  (P.L.  100-463),  gao 
reviewed  the  jurisdiction  and  the  mission  of  the  Office  of  the  Director, 
ot&e  to  determine  whether  the  Ot&e  Capability  Improvement  Program 
was  either  within  the  scope  of  that  mission  or  more  appropriately  would 
be  conducted  by  another  organization  within  dod.  gao  also  (1)  evaluated 
the  Director,  ot&e’s  coordination  with  the  services  and  the  intelligence 
community  in  acquiring  test  resources  and  (2)  reviewed  dod’s  submis¬ 
sion  to  the  Congress  supporting  the  fiscal  year  1989  program  to  ensure, 
among  other  things,  that  duplicate  test  resources  would  not  be  acquired. 


Background 


The  Congress,  concerned  that  ot&e  was  not  receiving  the  needed  empha¬ 
sis  and  independent  oversight,  established  the  Office  of  the  Director, 
OT&E.  (P.L.  98-94,  Sept.  24, 1983).  The  statute  designated  the  Director, 
ot&e  as  the  principal  ot&e  official  within  senior  dod  management  to 
ensure  that  systems  are  ready  for  production. 
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In  1986,  the  Director,  ot&e  established  the  ot&e  Capability  Improvement 
Program  as  assigned  by  the  Secretary  of  Defense.  The  program  was 
appropriated  $59  million  in  both  fiscal  years  1988  and  1989.  As  stated 
in  the  conference  report  on  the  dod  Appropriations  Act  for  Fiscal  Year 
1989,  dod  was  not  to  obligate  or  spend  the  fiscal  year  1989  funds  until  it 
submitted  to  the  Congress  a  list  of  items  to  be  acquired  with  the  funds 
and  gao  issued  this  report.  The  Office  of  the  Director,  ot&e  plans  show 
needs  for  the  program  totaling  about  $700  million  over  the  next  5  years 
(1990-94). 

During  gao’s  review,  the  program  was  restructured.  The  current  pro¬ 
gram  requires  the  services  to  identify  short-term  test  resource  require¬ 
ments,  which  are  reviewed  and  prioritized  by  a  tri-service  committee 
consisting  of  representatives  from  the  intelligence  and  testing  communi¬ 
ties.  dod  told  gao  that  a  list  of  the  test  assets  to  be  acquired  is  formally 
submitted  to  a  Test  and  Evaluation  Committee  for  coordination  and 
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approval.  The  Committee  is  a  forum  that  addresses  test  and  evaluation 
issues  at  the  Office  of  the  Secretary  of  Defense  (osd)  level.  Once 
approved,  the  items  are  to  be  acquired,  operated,  and  maintained  by  the 
services. 


Results  in  Brief 


Although  the  Office  of  the  Director,  ot&e’s  statute  does  not  prohibit  it 
from  conducting  the  ot&e  Capability  Improvement  Program,  gao 
believes  this  program  is  not  within  the  scope  of  the  Director,  ot&e’s  mis¬ 
sion  as  envisioned  by  the  Congress.  Since  the  services  have  primary 
responsibility  for  providing  the  necessary  test  resources  to  ensure 
proper  testing  of  their  weapon  systems,  it  is  essential  that  the  services 
plan,  program,  and  budget  test  resources  to  support  these  weapon 
systems. 

Even  though  the  services  are  responsible  for  identifying  test  resource 
requirements,  the  Director,  ot&e  did  not  adequately  coordinate  test 
resource  requirements  for  fiscal  year  1988  with  the  services  because  the 
Director,  OT&E  believed  the  services  would  not  participate  in  the  pro¬ 
gram.  Also,  the  Director,  ot&e  did  not  adequately  coordinate  the  acquisi¬ 
tion  of  test  resources  with  the  intelligence  community  because  the 
Director,  ot&e  did  not  believe  he  was  required  to  do  so.  As  a  result,  dod 
acquired  or  planned  to  acquire  about  $26  million  in  test  resources  that 
exceeded  service  requirements  or  whose  use  was  questionable. 

dod’s  submission  to  the  Congress  supporting  the  fiscal  year  1989  pro¬ 
gram  contained  only  a  general  description  with  few  specifics  of  items  to 
be  acquired.  If  funds  had  been  spent  at  the  time  of  dod’s  submission,  dod 
would  have  purchased  unneeded  items.  In  addition,  the  services  did  not 
fully  endorse  the  program,  and  coordination  procedures  proposed  by 
dod  at  the  time  were  not  f<  ,/>  ed. 


Principal  Findings 


The  Congress  envisioned  that  the  Director,  ot&e  would  oversee  ot&e,  not 
provide  resources.  For  example,  the  Office  of  the  Director,  ot&e’s  statute 
specifies  six  categories  of  functions  the  office  is  to  perform,  all  of  which 
are  oversight  rather  than  direct  management  functions.  The  law  states 


The  OT&E  Capability 
Improvement  Program  Is 
Not  Within  the  Director, 
OT&E’s  Mission 
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that  the  Director,  ot&e  shall  “review  and  make  recommendations  to 
the  Secretary  of  Defense  on  all  budgetary  and  financial  matters 
relating  to  operational  test  and  evaluation,  including  operational  test 
facilities  and  equipment”  in  dod. 

dod  stated  that  the  program  was  restructured  and  is  now  described  in  a 
program  plan  dated  November  9, 1989.  However,  gao’s  review  of  the 
plan  shows  that  the  Director,  ot&e  will  continue  to  manage  and  direct 
the  program  because  the  Director,  ot&e  is  still  responsible  for  the  pro¬ 
gram’s  funding  and  resource  management,  including  scheduling  tests 
based  on  plans  coordinated  by  a  tri-service  committee  and  various  day- 
to-day  functions  supporting  the  program.  Therefore,  the  Director,  ot&e 
is  still  performing  a  management  rather  than  an  oversight  function. 

The  best  way  to  improve  operational  test  and  evaluation  in  dod  is 
through  the  military  services  because  they  are  responsible  for  acquiring 
the  weapon  systems.  The  services  should  work  to  devote  sufficient 
resources  to  accomplish  realistic  testing  of  these  weapon  systems.  The 
Director,  ot&e  should  continue  to  play  an  important  role  in  oversight  and 
monitoring  of  the  services,  but  testing,  including  the  planning,  program¬ 
ming,  and  budgeting  for  adequate  test  resources,  should  be  managed  by 
the  services  themselves.  In  this  manner,  independent  oversight  can  be 
more  effectively  maintained. 


Director,  OT&E  Did  Not 
Adequately  Coordinate  the 
Program  With  the  Services 
or  the  Intelligence 
Community 


Coordination  with  the  services  and  the  intelligence  community  is  critical 
because  test  resources  may  be  acquired  that  exceed  service  require¬ 
ments.  Although  the  services  are  responsible  for  identifying  test 
resource  requirements,  the  Director,  ot&e  established  test  resource 
requirements  during  fiscal  year  1988  consisting  of  threat  equipment 
that  would  replicate  two  regiments.  The  Director,  ot&e,  however,  did  not 
adequately  coordinate  requirements  with  the  services  because  the  Direc¬ 
tor,  ot&e  believed  the  services  would  not  participate  in  the  program.  In 
addition,  the  Director,  ot&e  did  not  adequately  coordinate  the  actual 
acquisitions  within  other  OSD  organizations,  although  required  by  a  dod 
directive,  because  the  Director,  ot&e  did  not  believe  he  was  required  to 
do  so. 


For  fiscal  year  1989,  to  ensure  service  participation,  the  Director,  ot&e 
created  a  formal  tri-service  committee  to  identify  test  resource 
shortfalls  and  develop  plans  needed  to  acquire  test  resources.  However, 
the  Director,  ot&e  continued  to  experience  coordination  problems 
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because  the  tri-service  committee  was  not  used  to  identify  some  test 
resource  shortfalls. 


DOD’s  Congressional 
Submission 


The  conference  committee  on  the  fiscal  year  1989  appropriations 
directed  that  dod  not  obligate  or  expend  the  fiscal  year  1989  program 
funds  until  dod  provided  a  detailed  description  of  items  to  be  bought 
with  those  funds.  But  dod’s  January  9, 1989,  submission  to  the  Congress 
contained  only  a  general  description  with  few  specifics  of  items  to  be 
obtained  with  these  funds.  In  some  cases,  no  detailed  description  of  the 
items  was  provided.  In  others,  if  detail  was  provided,  the  item  was  not 
required  or  lacked  the  capability  required  by  the  service,  dod’s  submis¬ 
sion  stated  that  the  services  fully  supported  the  program’s  concept  and 
that  the  Test  and  Evaluation  Committee  was  to  preclude  unnecessary 
duplication.  However,  the  services  expressed  reservations  concerning 
the  Director,  OT&E’s  involvement  in  owning,  operating,  and  maintaining 
test  resources,  gao  also  found  that  the  Committee  had  little  involvement 
with  the  program.  As  a  result,  the  Director’s  priorities  for  test  resources 
were  not  confirmed  as  dod’s  priorities. 


Recommendations 


i 


Although  the  Office  of  the  Director,  ot&e  is  not  prohibited  by  statute 
from  conducting  the  OT&E  Capability  Improvement  Program,  gao 
believes  that  the  program  does  not  fall  within  the  Office  of  the  Director, 
ot&e’s  mission.  Therefore,  gao  recommends  that  the  Secretary  of 
Defense  direct  and  assure  that  the  services  plan,  program,  and  budget 
for  adequate  test  resources  needed  to  conduct  operational  testing  of 
weapon  systems  effectively.  The  Director,  ot&e  should  continue  to  per¬ 
form  oversight  and  policy  functions  by  reviewing  and  making  recom¬ 
mendations  to  the  Secretary  of  Defense  to  assure  that  adequate  test 
resources  are  acquired. 

Other  recommendations  are  included  in  the  classified  report  (gao/c- 
NSIAD-90-02). 


Agency  Comments 


dod  believes  that  the  Director,  ot&e  should  sponsor  the  ot&e  Capability 
Improvement  Program.  Although  dod  reaffirmed  the  services’  responsi¬ 
bility  for  acquiring  operational  test  resources  and  examined  proposed 
alternatives  to  the  program,  dod  believed  that  centralized  funding  of  test 
investments  is  essential  and  that  the  Director,  ot&e  has  the  operational 
test  insight  to  ensure  that  a  fully  coordinated  program  is  developed. 


Page# 


GA0/N8IAD-90-141  OT&E  Capability  Improvement  Program 


Executive  Summary 


Matters  for 
Consideration  by  the 
Congress 


dod  stated  that  the  Secretary  of  Defense  has  the  prerogative  to  assign 
the  Director,  ot&e  additional  responsibilities  and  that  the  Office  of  the 
Director,  ot&e’s  legislation  does  not  prohibit  the  Director,  ot&e  from 
sponsoring  such  a  program,  gao  agrees  that  the  Secretary  of  Defense  can 
assign  the  Director,  ot&e  additional  responsibilities.  Further,  as  stated  in 
the  gao  report,  gao  realizes  that  the  Office  of  the  Director,  ot&e’s  statute 
does  not  prohibit  it  from  executing  the  program.  However,  based  on 
GAO’s  review  of  the  Office  of  the  Director,  ot&e’s  legislation  and  the  cur¬ 
rent  program  approach  that  allows  the  Director,  ot&e  to  control  the  pro¬ 
gram’s  funding,  gao  continues  to  believe  that  the  office’s  mission  is 
oversight  as  opposed  to  resource  sponsorship.  Therefore,  in  order  for 
the  office  to  maintain  its  independent  oversight  responsibilities,  the 
Director,  ot&e  should  not  be  involved  in  the  management  role  of  control¬ 
ling  program  funds  and  directing  the  acquisition  of  test  resources. 

By  giving  the  Director,  ot&e  a  management  role  through  the  ot&e  Capa¬ 
bility  Improvement  Program,  dod  detracts  from  the  emphasis  it  should 
be  putting  on  having  the  services  play  the  key  role  in  acquiring  test 
resources.  Moreover,  putting  the  Director,  ot&e  in  the  role  of  controlling 
the  program  dilutes  the  Director,  ot&e’s  oversight  function  because  it 
gives  the  office  a  direct  stake  in  the  types  of  testing  and  test  assets  used 
by  the  services.  This  could  make  it  more  difficult  for  the  office  later  to 
provide  objective  and  critical  oversight.  For  example,  the  Director,  ot&e 
may  be  reluctant  to  criticize  a  testing  plan  that  contains  inadequate  test¬ 
ing  resources  when  the  Director  was  responsible  for  or  was  part  of  the 
process  of  directing  the  acquisition  of  such  resources. 


Since  gao  believes  that  the  ot&e  Capability  Improvement  Program  does 
not  fall  within  the  Office  of  the  Director,  ot&e’s  mission  and  should  be 
implemented  by  the  services,  the  Congress  may  wish  to  consider  legisla¬ 
tively  withdrawing  the  $59  million  appropriated  for  the  program  in  fis¬ 
cal  year  1989  and  making  it  available  for  use  by  the  services  to  acquire 
essential  operational  test  resources.  The  Congress  may  also  wish  to 
require  a  report  from  dod  specifying  how  the  funds  will  be  spent. 
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